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[57] ABSTRACT 

A method and system are disclosed for automatically 
visually inspecting an article such as an electronic cir- 
cuit wherein both reference and non-reference algo- 
rithms are utilized to detect circuit defects. The system 
includes a pipelined cellular image processor which is 
utilized to implement the non-reference algorithm and 
an arithmetic logic unit (ALU) is coupled to the output 
of the cellular image processor to perform the reference 
method. The non-reference method includes a spaces 
and traces algorithm and the reference method includes 
a topology matching algorithm. The system also in- 
cludes an algorithm for locating and gauging critical 
areas of the circuit with sub-pixel accuracy. The cellu- 
lar image processor is supported by a matched host 
image processor system 

14 Claims, 5 Drawing Sheets 
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to accommodate changes in the environment of the 
METHOD AND SYSTEM FOR AUTOMATICALLY system after the system is installed. 

VISUALLY INSPECTING AN ARTICLE One type of cellular processor particularly adaptable 

for machine vision applications is called the Cytocom- 
This is a continuation of co-pending application Ser. 5 puter. The Cytocomputer includes a series of pipelined 
No. 140,667 filed on Jan. 4, 1988 now abandoned which processor stages. Pipelining is a form of processor paral- 
is a continuation of Ser. No. 791,470 filed Oct. 25, 1985, lelism commonly termed "temporal parallelism". Each 
now abandoned. processor stage of the Cytocomputer comprises an 

eight-bit, general purpose, neighborhood image proces- 
TECHNICAL FIELD jq sor# Ea Cn stage executes a logical, comparison or arith- 

This invention relates to a method and system for metic function on a three-by-three neighborhood of 
automatically visually inspecting articles and, in partic- pixels and transmits the result to its succeeding stage in 
ular, to methods and systems for automatically visually ^ pipehne. A characteristic example of such a function 
inspecting articles such as electronic circuits. k * Sobel operator or a maximum neighbor selection. 

15 Images to be transformed are serially input to the Cyto- 
BACKGROUND ART computer in a raster scan format, with the effect that a 

The electronic revolution of the 80*s has brought three-by-three window "slides" across the image in a 
about further miniaturization of electronic devices and raster scan fashion. 

circuits and with it an ever-increasing need for auto- ^ Cytocomputer is capable of executing a range of 
made visual inspection. As product reliability becomes 20 processing tasks at high speed due to its relatively 

increasingly more important, electrical testing alone is efficient architecture. Organization of the stage process- 
not sufficient to detect many of the defects affecting ing elements as a systolic array allows multiple use of 
long-term reliability. Thus visual inspection is required. each m P ut *** Item ^ ereb V ."^B the system's 
This is a difficult task for human inspectors due to the commutation costs and complexity The systolic ap- 
vast amounts of information that must be processed at 25 P r ° a ? h dso P/™** a s ™? le ' mternai J* 8 * 6 

ever-increasing production rates within strict resolution ^ mte *T that aUows 

requirements. stage at the maximum rates afforded by the technology 

Virtually all phases of automatic visual inspection of of the integrated circuit 

. ,_■ * r J i_ Each Cytocomputer processing element is based on a 

electronic circuits is the subject of current research. , rt . \ t. ♦ • * -» <M „ • 

„ , , i j • •* n j ^ 30 custom gate array which contains about 2,500 equiva- 

Researchers have analyzed circuit flaws and specified * Consequently, each processing element can 

some algorithms for detecting them. Other re^archen ^^fi^ ^ CT ^ at a rate exceeding 10 

have described prototype printed wiring board (PWB) 

inspection systems and imaging and image processing of ^ * ^ stage ^ organized as a three-by-three 
thick film circuit. Computer Nosion technology has ako 35 ^ of neighborhood pixel processing cle- 

being proposed for inspecting integrated circuits (ICs). ments A set of delay line memories is used to form the 

Much of the research currently being done is also neighborhood window and data from the window flows 
applicable to the general problem of inspecting two-di- through the array of processing elements. The output 
mensional patterns having several colors and shades of signals from the nine processing elements are combined 
gray. This includes character recognition, inspecting 4Q according to specified Cytocomputer instructions so 
for defects in discs and tapes, CRT inspection, etc. tnat a replacement pixel value is generated and passed 

The need for high-performance image analysis sys- t0 tnc ncxt stage m th e pipeline. The Cytocomputer is 
terns in industrial, scientific and defense applications has fuUy pipelined internally so that after a delay to fill the 
speeded the development of high-speed image proces- pipeline, a processed pixel is output from the stage 
sor architectures. One of the most promising techniques 45 whenever an input pixel is clocked into the stage, 
for the construction of fast, efficient vision systems xhe ability to pipeline stages is a key feature which 
centers on the concept of cellular automata. results in high performance of the Cytocomputer. Each 

Early investigators in the Meld of image processing stage is capable of processing 10 million pixels per sec- 
identified the unique capability of cellular computer 0 nd and a pipeline of 10 such stages is capable of 100 
architecture to solve vision problems. However, while 50 million eight-bit pixel operations per second. In a typi- 
these designs had potential for good performance in cal application a 10-stage pipeline can perform any 10 
machine vision applications, system performance was point or neighborhood instructions on a 512x512 pixel 
limited by the circuit technology available to build such image in less than one video frame time (i.e. 33 millisec- 
machines. Advances in integrated circuit technology onds). For example, the Sobel operator can be per- 
have made cellular processors practical for incorpora- 55 formed on a 512X512 image in 26.2 milliseconds. In 
tion into machine vision systems. principle large numbers of stages can be pipelined. 

Machine vision image operations generally require However, in practice, most applications are satisfied by 
substantial amounts of low-level, computationally in- Cytocomputers on the order of eight to 10 stages long 
tense, point and neighborhood computations. Tasks since non-Cytocomputer devices contained within the 
such as electronics inspection require the analysis of 60 system soon become bottlenecks to system perfor- 
tremendous amounts of data from which spatial integ- mance. 

rity of circuit patterns is inferred. Local neighborhood The basic neighborhood processing technique is es- 
operations are ideal for this purpose. By contrast, medi- sential to most important low and medium-level image 
cal data processing typically operates on images with transformation and the Cytocomputer is optimized to 
low signal-to-noise levels and substantial signal en- 65 perform these operations. The Cytocomputer was origi- 
hancement through filtering is necessary. nally designed for morphological operations such as 

Key requirements of a machine vision system are erosions, dilations and skeletonizations. Mathematical 
reprogrammability and good future growth capability morphology is a compact method of performing gaug- 
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ing operations in machine vision tasks. For example, 
inspection of a thick film substrate or an integrated 
circuit mask for design rule violations can be performed 
as a series of erosions and dilations as illustrated in U.S. 
Pat No. 4,441,207. An image of such a circuit can be 5 
globally inspected for short and open circuits in a few 
time frames. 

The Cytocomputer also supports most common lin- 
ear mask operations such as Sobel, Roberts, Laplacian 
and gradient and also common 3X3 convolutions. 10 
These operations are pipelined and can be performed 
along with morphological operations. 

Further details of the Cytocomputer can be obtained 
from the U.S. Patents assigned to the Environmental 
Research Institute of Michigan, all of which are hereby IS 
incorporated by reference. 

Several types of algorithms or methods for detection 
of electronic circuit defects have been developed over 
the years. These algorithms and the systems utilizing 
same can be classified into three general categories: 20 
reference system pattern matching; non-reference or 
generic property verification; and, measurement or 
gauging. 

Reference systems compare pixel values or properties 
of a known good circuit with those of a circuit under 25 
test. The matching may be done by direct comparison 
of intensity values, by comparison of statistical or spa- 
tial features, or by matching nodes and end points in a 
graph which defines the topology of the circuit. Mis- 
matches between the reference pattern and the image 30 
under test are used to detect flaws. One advantage of 
the reference approach is that much of the knowledge 
required to determine if a circuit is good is contained 
within the reference pattern. One of the problems with 
. this approach is the difficulty in accurately registering 35 
or aligning the two images for comparison, thereby 
resulting in an ambiguity range between a good and a 
defective circuit. Another problem with the reference 
approach is that the data representation of the reference 
image must be sufficiently compact to avoid excessive 40 
memory costs and slow data transfer rates. In general, 
the reference method is good in finding gross defects 
but has more trouble in detecting flaws small in size 
relative to the entire image because of the misregistra- 
tion problem. 45 

Non-reference systems differs from reference systems 
in that no comparison between the image to be in- 
spected and a reference image is needed. This approach 
does not average the various features in an image into a 
single statistic or set of statistics but instead analyzes 50 
each of the features individually. Thus an important 
advantage of this approach is that no information is lost. 
Such a system searches an image for the presence of a 
specific set of features. Flaws are detected by the pres- 
ence or absence of these features. In order for such a 55 
system to be successfully implemented, the set of guide- 
lines used to detect or describe any given feature must 
be unambiguously defined and must be applicable 
throughout the entire image being inspected. 

The non-reference method is most effective in appli- 60 
cations where a set of rules applies to each point in the 
circuit. If this method is to be exclusively used, then the 
inspection criteria must be described by a compact, 
context-independent set of specifications. Unfortu- 
nately, design rules are routinely violated throughout 65 
the circuit manufacturing industry without affecting the 
functionality of a circuit design such as a thick film 
circuit design. With respect to thick film designs, the 



4 

presence of multiple layers can cause the appearance of 
violations when in fact no error has occurred. The 
impact on the non-reference method is that the list of 
inspection rules can potentially become very long, re- 
sulting in a time-consuming algorithm. In summation, 
the non-reference method is not general enough to be 
applicable under a wide variety of conditions and often 
becomes "crippled" when rule violations occur. 

Measurement or gauging systems are often designed 
to report dimensions of patterns and provide feedback 
(X, Y and theta measurements for alignment) for pro- 
cess control These systems assume that the measure- 
ment area is defect free and that a good estimate, at least 
in a least squares sense, is available to locate the position 
of each pattern precisely. Most commercially available 
circuit board inspection systems do not provide full- 
function circuit inspection and dimensional measure- 
ment. For hybrid inspection systems alignment is very 
important and in integrated circuit inspection systems, 
precise line width measurements are required. Measure- 
ment accuracy at any single location is also affected by 
digitization. Confidence in the measurement is typically 
plus or minus the size of each pixel or picture element 

Thick film electronic circuits are commonly pro- 
duced on a ceramic substrate. Several layers consisting 
of a conductor, resistor, dielectric and solder paste pat- 
terns are printed with various inks onto the substrate 
using screen printing and subsequent firing processes. 
After these operations, components are placed onto the 
substrate. Automatic visual inspection of each of the 
printed layers before component assembly is desired 
since checking such circuits is putting ever more strain 
on human inspectors. Designs are growing more com- 
plex with thinner lines, larger substrates and the greater 
user of multilayer construction. This inspection must be 
performed both before and after firing the individual 
layers (i.e. when both the layer is wet and again when it 
is dry). Typical flaws include voids, cracks, misalign- 
ment, path spacing and width errors etc. Resolution 
required from inspection is typically in excess of one mil 
(Le. 0.001 inch). The surface area of each circuit is fre- 
quently one million square mils. 

Missed defects because of lapses in human concentra- 
tion or fatigue can be expensive. Buried flaws in multi- 
layer circuits are virtually impossible to repair. The cost 
of a defect multiplies if it reaches the next stage of pro- 
duction which is assembly. 

Inspection time becomes more and more an issue as 
manufacturers move into large substrates of dense, mul- 
tilayer designs. In such cases, human inspection of the 
layers may be measured in minutes. The task puts a 
heavy burden on manufacturing people creating a po- 
tential bottleneck. It is desirable if such automatic vision 
systems be capable of generating a data base necessary 
for statistical reporting to achieve process control. 

DISCLOSURE OF THE INVENTION 

An object of the present invention is to provide an 
improved method and system for automatically visually 
inspecting an article which combines both reference 
and non-reference algorithms to provide rapid and reli- 
able inspection. 

Another object of the present invention is to provide 
a method and system for automatically visually inspect- 
ing an electronic circuit using both reference and non- 
reference algorithms and which also has the capability 
of locating and gauging critical areas in the circuit pat- 
tern with sub-pixel accuracy. 
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Yet still another object of the present invention is to 
provide a system for automatically visually inspecting 
an article including a cellular image processor to per- 
form neighborhood operations and an arithmetic logic 
unit to perform image and scalar operations for rapid 5 
and cost-effective inspection. 

In carrying out the above objects and other objects of 
the present invention a method for automatically visu- 
ally inspecting articles comprises the steps of acquiring 
a first set of image data representing a known article and 10 
acquiring a second set of image data representing an 
article under inspection. The method further comprises 
the step of processing both sets of image data to separate 
each of the images into at least two identifiable areas 
having a boundary therebetween. The method also 15 
includes the step of checking the second set of pro- 
cessed image data with at least one preselected geomet- 
rical constraint to identify areas in noncompliance. 
Also, the two sets of processed image data are matched 
to identify areas where mismatches occur. 20 

A system for automatically visually inspecting an 
article comprises means for acquiring first and second 
sets of image data wherein the first set of image data 
represents a known good article and the second set of 
image data represents an article under inspection. The 25 
system also comprises means for processing both sets of 
image data to separate each of the images into at least 
two identifiable areas having a boundary therebetween. 
The system includes means for checking the second set 
of processed image data with at least one preselected 30 
geometrical constraint to identify areas of non-compli- 
ance. Means are also provided for matching the two sets 
of processed image data to identify areas where mis- 
matches occur. 

The advantages of the above method and system are 35 
numerous. For example, flaws are detected in a rapid 
and reliable fashion due to the combined approach of 
matching a segmented image with an image-like repre- 
sentation of a defect free article and by using a minimum 
width/spacing violation detector. In this way the limi- 40 
tations of both the reference and non-reference algo- 
rithms are substantially overcome. 

Furthermore, the method and system combine the 
best elements of design matching, design rule checking 
and measurement to thereby obtain high throughput 45 
and high accuracy while still remaining cost effective. 
This method and system are sufficiently general and 
applicable to the inspection of different types of circuits 
such as PWB's and ICs and also to the general problem 
of inspecting two dimensional patterns which have 50 
several colors and shades of gray. This includes charac- 
ter recognition, inspecting for defects in disks and tape, 
CRT inspection, etc. 

Other advantages of the present invention will be 
readily appreciated as the same becomes better under- 55 
stood by reference to the following detailed description 
when considered in connection with the accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS ^ 

FIG. 1 is a schematic view of an automatic visual 
inspection system constructed in accordance with and 
operable for practicing the method of the present inven- 
tion; 

FIG. 2 is a top plan view, partially broken away, of a 65 
thick film circuit capable of being inspected in accor- 
dance with the method and system of the present inven- 
tion; 



FIG. 3 is aschematic top plan view of a portion of the 
circuit of FIG. 2 illustrating various circuit defects; 

FIG. 4 is a schematic block diagram of the electronic 
hardware used in the system; 

FIG. 5 is a generalized block diagram of the method 
of the present invention; 

FIG. 6 is a more detailed block diagram of the seg- 
mentation algorithm of the present invention; 

FIG. 7 is a more detailed block diagram of the gaug- 
ing check algorithm of the present invention; 

FIG. 8 is a more detailed block diagram of the refer- 
ence image generation algorithm of the present inven- 
tion; 

FIG. 9 is a more detailed block diagram of the topol- 
ogy check algorithm of the present invention; and 

FIG. 10 is a more detailed block diagram of the path 
and space checking algorithm of the present invention. 

BEST MODE FOR CARRYING OUT THE 
INVENTION 

Referring now to FIG. 1 of the drawings there is 
illustrated a system, collectively indicated at 10, for 
automatically visually inspecting an article. As illus- 
trated herein, the article may comprise thick film elec- 
tronic circuits, generally indicated at 12, produced on a 
ceramic substrate as shown in FIG. 2. 

The system 10 is able to identify certain materials and 
detect defects such as shorts, opens, voids, extra mate- 
rial and misregistration of the layers of the film circuit 
12. Examples of such defects are shown in FIG. 3. 

While the article under inspection described hereinaf- 
ter comprises a substrate of thick film electronic circuits 
12, it is to be understood that other types of electronic 
circuits such as PWB's and ICs may also be inspected 
by the method and system described herein. Also, two- 
dimensional patterns having several colors and shades 
of gray may also be inspected by this method and sys- 
tem. 

The system 10 includes an illumination and imaging 
subsystem, generally indicated at 14, for providing a 
high contrast image of the circuit 12 being tested. As 
illustrated in FIG. 2, to the human observer the materi- 
als which make up the thick film circuit 12 may appear 
in varying colors and shades of gray and may be wet, 
dry or fired at various stages of production. Thick film 
conduction materials include silver palladium, silver, 
gold, and copper, all of which differ in appearance. Wet 
resistors are often very dark and have a strong specular 
reflection component when wet. Dielectrics are often 
transparent and therefore color is often added for visual 
identification. It is not uncommon to find several color- 
coded dielectrics and different conductor types printed 
on a single substrate. For example, a multilayer circuit 
board may have gold and silver palladium conductors, 
blue and green dielectric patterns and resistors. 

Polarization and color discrimination techniques are 
useful for acquiring a high contrast image of the circuit 
12 under a wide variety of conditions. Color informa- 
tion can also be used to aid subsequent segmentation of 
the image for which a monochrome image is not suffi- 
cient for discrimination of the materials. Separation 
between dielectric and substrate in a monochrome 
image is possible by using different narrow band filters 
which can be selected to maximize the difference in 
spectral response between the dielectric and substrate. 

While not specifically utilized in the method and 
system of the present invention, multichannel and color 
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imaging may be utilized for more complex multilayer buffers 36 and the system 30. Preferably, the board 40 

hybrid circuits, comprises the ALU-512 of Imaging Technology, Inc. 

As illustrated in FIG. 2, the minimum line widths and The output of the pipeline 28 is directed by the con- 

spacings between different circuit materials range from trofler 29 through one of the frame buffers 32 to the 

about 10 mils down to about 2 mils. Preferably, digitiza* 5 ALU 40 which combines stored images from the host 

tion of the analog image signal is done at approximately processor system 30 with the pipeline processed results. 

I /10th of the minimum design rule utilized as described This capability is useful when neighborhood processing 

in more greater detail hereinafter. Resolution and depth is performed on an acquired image and the results are 

of field requirements for imaging such a circuit shows compared against a template image by the ALU 40 as 

that 0.2 mils is the approximate practical resolution limit 10 will be described in greater detail hereinbelow. 

without using an autofocus camera. The ALU 40 also acts as a central switching device 

The subsystem 14 includes a F/8 microscope zoom- for the data busses 32. Furthermore, the ALU 40 per- 

objective camera 16 for imaging the circuit 12 over the forms arithmetic and logical functions and contains a 

needed magnification range. The camera 16 preferably 16-bit barrel shifter and an eight-bit multiplier. The 

comprises a solid state CCD array camera. A halogen 15 ALU 40 also controls the acquisition and display of 

lamp 18a is connected to a ring illuminator 18 via a images on a display 42. 

fiber-optic bundle 19b for illuminating the article under The host system also includes a histogram/feature 

inspection. extractor 44, which preferably comprises an HF-512 

The output of the camera 16 appears on a line 20 and also available from Imaging Technology, Inc. The his- 

comprises a digitized signal representing the optical 20 togram/feature extractor 44 extracts up to 4,096 fea- 

power received. A camera status signal is also provided tures in one frame time and computes a histogram in 

along the line 20 and is input to interface circuitry 22. two frame times based thereon. The results of the pre- 

The interface circuitry 22 outputs control signals along cess are available to the host processor system 30 via the 

line 24 to the camera 16 to control its operation and multibus 46. 

interfaces with an image processing and control system 25 . The host system further includes an analog processor 
generally indicated at 26 in FIGS. 1 and 4. or a frame grabber/display controller 48 which prefera- 
The circuit 12 is supported on a fixture 13 having bly comprises an AP-512 from Imaging Technology, 
solenoids (not shown) contained therein to control lo- Inc. The processor 48 is coupled to the display 42, the 
eating pins 15 which, in turn, position the circuit 12 on extractor 44 and the ALU 40. The processor 48 is capa- 
the fixture 13. The camera 16 is supported on a camera 30 ble of supporting two video cameras and has three out- 
stand or support structure adjacent the fixture 13. put channels for pseudocolor operation, as well as three 

Referring again to FIG. 4, there is illustrated in detail composite video outputs, 
the architecture of the system 26. The system 26 in- The combination of the pipeline 28 and the ability of 
eludes a Cytocomputer pipeline 28 controlled by a Cyto the ALU 40 to control data bus interconnections allows 
controller 29 as previously described herein, in U.S. 35 multiple images to be simultaneously switched between 
patent application entitled "Image Analyzer System frame buffers 36 and sent to the various processing 
Having Neighborhood Arithmetic Processing Capabili- elements such as the pipeline 28, the ALU 40, the histo- 
ries", and in the references cited therein. The controller gram/feature extractor 44, and the video display 42 by 
29 interfaces the bus architecture of the host system to appropriate programming of the data path interconnec- 
that of the pipeline 28 and provides local storage of 40 tions. This allows multiple system operations to occur 
Cytocomputer programs. , in parallel with operations within the pipeline 28. Fur- 
Hie pipeline 28 is supported by a host system includ- thermore, in addition to processor parallelism in the 
ing a host processor system, generally indicated at 30. pipeline 28, images may be manipulated in parallel at the 
Control provided by the host processor system 30 is system level 

provided by a processor 38 which preferably comprises 45 Referring now to FIG. 5, there is illustrated in gen- 

an MC 68000 processor of the Motorola Corporation. eral flowchart format the various steps taken by the 

The system 30 also includes a local memory 37 sup- system 10 in order to automatically visually inspect an 

ported by an appropriate peripheral such as a hard disc article such as the circuit 12. After an image is acquired 

39. The host processor system 30 communicates with by the illumination and imaging subsystem 14, the fix- 

the remainder of the system 26 by means of a Multibus 50 ture 13 is moved under control of the system 26 along 

46 from the Intel Corporation. line 50. Prior to detecting flaws in the acquired image. 

In general, the components of the host system are the image data is then segmented by a segmentation 

chosen to operate at a speed adequate to efficiently use algorithm to identify the materials i.e. conductor, resis- 

the pipeline 28. The pipeline 28 is preferably supported tor, dielectric, solder, etc. from the gray scale data 

by an image processor called the IP-5 12, from Imaging 55 produced by the imaging subsystem 14. Most vision 

Technology, Inc. of Woburn, Mass. The host system algorithms require some type of segmentation to sepa- 

comprises four video rate, (Le. 10 MHz) eight-bit data rate the objects of interest from the background. The 

busses 32 for image transfers and two analog video rate segmentation algorithm is shown in greater detail in 

busses 34 for image acquisition and display. FIG. 6. Briefly, the segmentation procedure reduces the 

The host system also includes four high-speed image 60 range of gray values into several distinct states, each of 

memories or frame buffers 36 coupled to the pipeline 28 which represents a particular pattern, class or material 

and the system 30 to provide transparent dual port ac- within the image. 

cess for both the processor 38 and video bus I/O. Each Segmentation by thresholding is a simple fast tech- 
buffer 36 contains independent pan and scroll control, nique which is useful if high dimensional accuracy is not 
as well as pixel and memory plane protection. Images 65 required and if a high contrast, very stable input image 
may be acquired into any of the buffers 36. is available. However, if dimensional accuracy and 
The host system also includes a 16-bit software con- stability are required for gauging, as in the case of iden- 
trolled ALU board or ALU 40 coupled to each of the drying the various layers of a thick film circuit, then a 
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segmentation algorithm which uses both intensity levels 
(i.e. thresholding) and spatial information (Le. edge 
information) as shown in FIG. 6 is required. In FIG. 6, 
the original image is first filtered by non-linear or 
"order statistic** filters which smooth between bound- S 
aries in the image but do not blur edges. Thresholding 
of the image is then performed by a histogram analysis 
routine to help identify homogeneous regions. East, 
west, south and north directional derivatives are there* 
after applied to the filtered data in order to get good 10 
image edges for gauging. This is accomplished by ap- 
plying such functions as a Sobel operator and maximum 
neighbor selection functions to the filtered data in the 
pipeline 28. 

Thereafter, the directional derivatives are combined IS 
and the edges are refined such as by edge Unking, edge 
classification, recruitment, weak edge suppression, clos- 
ing small gaps and edge thinning. 

Finally, the spatial information is applied to the 
threshold image to resolve ambiguities by classifying 20 
pixels in the border regions based upon their relation- 
ship to the neighboring homogeneous regions, thus 
providing accurate locations of each of the patterns or 
regions. 

Referring again to FIG. 5, after segmentation an 25 
image-like representation (Le. a topology map) of a 
good known circuit must be constructed in order to use 
the reference or pattern matching method of defect 
detection. In order to avoid excessive memory costs and 
slow data transfer rates, the reference image is com- 30 
pacted or compressed as shown in FIG. 8 to reduce the 
number of data points which represents the reference 
image prior to storing same. Initially, the edges between 
adjacent areas in the data are smoothed. Then the data 
is reduced to a left-sided, vertical edge. Thereafter, the 35 
vertical edges are reduced so that only every third pixel 
is represented. Finally, the remaining points are stored. 

In order to check the topology of a circuit under test, 
the reference image is regenerated by reversing the data 
compression algorithm in the pipeline 28 as shown in 40 
FIG. 9. Border regions are constructed around each 
region in the reference image. Then a direct comparison 
is made between the reference image and the image 
under test to locate any flaws and determine the defect 
type. A thinning operator is applied to both inside and 45 
outside the area of overlap to check for continuity in 
order to classify the flaws. This technique does not 
require processing of the image under test, but only 
processing of the reference image. This method pro- 
vides a direct method for determining location, size and 50 
context information for the detected flaw. Mismatches 
between the image under test and the reference image 
are characterized as flaws. The extent of the flaw is 
determined by expanding the defective region over the 
flawed region to preserve the size, type and location of 55 
the flaw. 

Referring again to FIG. 5 and to FIG. 7 t a gauging 
check algorithm is provided for dimensional measure- 
ment The algorithm provides sub-pixel accuracy de- 
spite digitization noise. Initially, an edge detection step 60 
is used to obtain an edge location representation of the 
circuit under test. Then the coordinates of the con- 
nected edge components are extracted from the image. 
Finally, lines or curves are fitted to the coordinates of 
the connected edge components in a least squares gang- 65 
ing module to locate the line and curve segments with 
high precision. In this way, the edge can be located 
within an accuracy of at least plus or minus 0.5 pixels. 
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Referring again to FIG. 5 and to FIG. 10 there is 
illustrated a path and space checking algorithm which 
supplements the reference method of FIG. 9. In general, 
the path and space algorithm checks patterns which 
"neck down" or have other irregularities, such as small, 
concave regions. 

Initially, the image is thinned to locate circuit paths. 
Then, the input image is eroded or contracted to label 
areas which violate a minimum design rule. Finally, the 
results of the first two steps are combined to label all 
paths where a violation occurred. Any path which is 
below the design rule will be flagged. Defects larger 
than the design rule are detected by the topology check 
method. 

By utilizing both the reference and non-reference 
algorithms, flaw coverage overlaps. For example, some 
of the flaws illustrated in FIG. 3 will be detected by 
both methods. Another advantage is that the system 10 
can be programmed to execute very efficiently, leading 
to a high throughput system when both reference and 
nonreference methods are utilized. Furthermore, be- 
cause the complexity of multilayer hybrid circuits is 
steadily increasing, the invariant sets of rules of the 
non-reference method sufficient for detection of all 
defects is increasingly difficult to specify. Even if such 
rules could be specified, they would be very long, re- 
sulting in a time-consuming algorithm. 

The advantages of the above-described system and 
method are numerous. For example, the system 10 is 
designed for high throughput and high accuracy while 
remaining a cost-effective solution to practical circuit 
inspection problems. This is accomplished by combin- 
ing reference, non-reference and measurement methods 
or algorithms in a system which is general and also 
applicable to the inspection of other types of circuits 
such as PWB's and ICs. Such a method and system is 
also capable of inspecting two-dimensional patterns 
having several colors and shades of gray. Such applica- 
tions also include character recognition, inspecting for 
defects in disks and tapes, CRT inspection, etc. 

While the best mode for carrying out the invention 
has been described herein in detail, those skilled in the 
art to which this invention relates will recognize vari- 
ous alternative designs and embodiments for practicing 
the invention as defined by the following claims. 

What is claimed is: 

1. A method for automatically and visually inspecting 
an article, the method comprising the steps of: 

acquiring a first set of digital image data representing 
a known good article, the image data representing 
a two dimensional reference image, processing the 
first set of image data to separate the reference 
image into at least two identifiable areas having a 
boundary therebetween; 

compressing the reference image in each of the two 
dimensions of the reference image, the step of com- 
pressing including the steps of reducing at least one 
of the areas of the reference image to an edge rep- 
resented by a number of data points and reducing 
the number of data points representing the edge; 

storing the compressed reference image; 

acquiring a second set of digital image data represent- 
ing a two-dimensional image of an article under 
inspection; 

processing the second set of digital image data to 
separate the image of the article under inspection 
into at least two identifiable areas having a bound- 
ary therebetween; 
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retrieving the compressed reference image; 

regenerating the retrieved reference image, said step 
of regenerating including the step of regenerating 
the edge from the reduced number of data points, 5 
regenerating the at least one of the areas from the 
regenerated edge, and constructing border regions 
around at least one of the areas of the reference 
image to obtain a regenerated reference image; and 

matching the regenerated reference image and the 10 
image of the article under inspection to identify 
areas where mismatches occur. 

2. The method as claimed in claim 1 wherein the 
article includes electronic circuitry such as a multilayer ^ 
thick-film circuit having a plurality of components. 

3. The method as claimed in claim 1 or 2 including the 
step of measuring at least one dimension of one of the 
areas of the image of the article under inspection. 

4. The method as claimed in claim 1 or 2 further 20 
comprising the step of checking the second set of pro- 
cessed data with at least one preselected geometrical 
constraint to identify areas of non-compliance. 

5. The method as claimed in claim 4 wherein the step 2 j 
of checking includes the step of checking the second set 
of image data with a preselected width constraint 

6. The method as claimed in claim 4 wherein the step 
of checking includes the step of performing a series of 
neighborhood transformations on said second set of 30 
image data. 

7. The method as claimed in claim 6 including the 
step of generating a bit map flagging the areas of non- 
compliance. 35 

8. The method as claimed in claim 4 including the 
step of combining said areas of non-compliance and said 
areas where the mismatches occur to identify defects. 

9. A system for automatically, visually inspecting an 
article, the system comprising: 40 

means for acquiring first and second sets of digital 
image data, the first set of image data representing 
a two-dimensional reference image of a known 
good article and the second set of image data repre- 45 
senting a two-dimensional image of the article 
under inspection; 



means for processing the first set of image data to 
separate the first set of image data into at least two 
identifiable areas having a boundary therebetween; 

means for compressing the reference image in each of 
the two dimensions of the reference image, said 
means for compressing including means for reduc- 
ing at least one of the areas of the reference image 
to an edge represented by a number of data points 
and means for reducing the number of data points 
representing the edge; 

means for storing the compressed reference image; 

means for retrieving the stored compressed reference 
image; 

means for regenerating the reference image, said 
means for regenerating including means for regen- 
erating the edge from the reduced number of data 
points representing the edge, means for regenerat- 
ing the at least one of the areas of the reference 
image from the edge; and means for constructing 
border regions from the at least one of the areas of 
the reference image to obtain the regenerated refer- 
ence image; and 
means for matching the regenerated reference image 
and the image of the article under inspection to 
identify areas where mismatches occur. . 
10. The system as claimed in claim 9 wherein the 
article includes circuitry such as a multilayer thick film 
circuit having a plurality of components. 

11; The system as claimed in claim 9 wherein said 
means for matching includes an arithmetic logic unit for 
comparing the regenerated reference image and the 
second set of processed image data. 

12. The system as claimed in claim 10 further com- 
prising means for checking the set of processed image 
data with at least one preselected geometrical constraint 
to identify areas of non-compliance. 

13. The system as claimed in claim 12 wherein said 
means for checking includes a pipeline of serial neigh- 
borhood transformation stages for processing the sec- 
ond set of image data. 

14. The system as claimed in claim 13 wherein said 
means for matching includes an arithmetic logic unit 
selectively coupled to the output of the pipeline and 
selectively coupled to said means for regenerating for 
combining the regenerated reference image and the 
second set of image process data. 
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